METHOD OF EXTRACTING EPIPOLAR CURVE OF STEREOSCOPIC 
IMAGE PHOTOGRAPHED BY LINEAR PUSHBROOM (LPB) SENSOR 

BACKGROUND OF THE INVENTION 

5 

Field of the Invention 

The present invention relates to a method of extracting 
an epipolar curve of a stereoscopic image photographed by a 
linear pushbroom (LPB) sensor, and more particularly, a 

10 technology which proposes a method of extracting an epipolar 

curve of a stereoscopic image photographed by a linear 
pushbroom (LPB) sensor, to which a method for a general 
perspective sensor cannot be applied, to enable both a 
creation of a precise three-dimensional (3D) topography 

15 information and a processing of the stereoscopic images. 

Description of the Related Art 

The linear pushbroom (LPB) sensor used herein refers to 
a sensor which is capable of obtaining an image through a 

20 photographing method or scanning method in which when an 

object is photographed, a focal point is moved successively, 
so a separate focal point exists by each line or part within 
an image of the object. The perspective sensor used herein 
refers to a sensor which has a single fixed focal point per an 

25 image of an object. 



1 



The stereoscopic image used herein refers to more than 
two images that photograph the same region of a topography at 
different angles and different positions. 

The epipolar curve used herein refers to a locus on the 
right image (or the left image) representing all possible 
positions that a point of the left (or the right) image is 
corresponding to, assuming that the stereoscopic image 
consists of the two images without departing from the scope of 
a generality and naming the two images as the left and right 
image, respectively. 

Fig. 1 is a diagrammatic view illustrating an epipolar 
curve of a stereoscopic image photographed by a perspective 
sensor according to the prior art. 

The epipolar curve of the stereoscopic image will now be 
described hereinafter with reference to Fig. 1. 

First, a focal point of the left image is defined as S, 
one point of the left image is defined as q, and the line 
connecting the focal point S of the left image and the one 
point q of the left image is defined as a straight line Sq 
with respect to a ground reference (control) coordinate 
system. 

The point on the earth surface or the surface of a 
photographed region corresponding to the one point q of the 
left image is defined as a ground point Q, and the position of 
the ground point Q always exists on an extension line of the 



straight line Sq. One point q' of the right image 
corresponding to the ground point Q is called a conjugate 
point of q, and the one point q' of the right image is the 
intersection between a straight line defined to pass through 
the focal point S' of the right image from one point on the 
extension line of the straight line Sq and the surface of the 
right image. 

At this time, a set of intersection points between the 
surface of the right image and straight lines connecting the 
focal point S' of the right image and all the points on the 
extension line of the straight line Sq is represented in the 
form of a curved line, and this curved line is called an 
epipolalr curve of the right image corresponding to the one 
point q of the left image. 

That is, the one point q' corresponding to the 
counterpart of the one point q of the left image always exists 
on the epipolar curve. An epipolalr curve of the left image 
corresponding to the one point q' of the right image can also 
be defined vice versa based on such explanation on the 
epipolar curve of the right image corresponding to the one 
point q of the left image. 

As described above, in case of the stereoscopic image 
photographed by a perspective sensor, the epipolar curve of 
the stereoscopic image is represented in the form of a 
straight line, and a technology for extracting this epipolar 



curve has already been developed and is widely used. 

However, despite the epipolar curve of the stereoscopic 
j_ mage photographed by the perspective sensor has a main 
characteristic of the stereoscopic image and is included in 
5 almost all photogrammetry textbooks, there have not been 

disclosed a method of extracting the epipolar curve of the 
stereoscopic image from the linear pushbroom (LPB) sensor, 
having a characteristic that when an object is photographed, a 
focal point is moved successively and a separate focal point 
10 exists by each line or part within an image of the object. 

In addition, although a method of extracting the 
epipolar curve of the stereoscopic image photographed by the 
linear pushbroom (LPB) sensor is not identical with a method 
of extracting the epipolar curve of the stereoscopic image 
15 photographed by a perspective sensor, the two methods are 

wrongly considered to be identical and the latter are mis-used 
for the former, thereby resulting in a generation of an error. 

SUMMARY OF THE INVENTION 

20 

Therefore, the present invention has been made in view of 
the above-mentioned problems, and it is an object of the 
present invention to provide a method of correctly extracting 
an epipolar curve of the right image (or left image) 
25 corresponding to one point of the left image (or the right 
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image) in a stereoscopic image photographed by a linear 
pushbroom (LPB) sensor. 

According to the present invention, there is provided a 
method of correctly extracting an epipolar curve C' q of the 
5 right image (or an epipolar curve C q > of the left image) 

corresponding to one point q of the left image (or one point 
q' of the right image) in a stereoscopic image photographed by 
a linear pushbroom (LPB) sensor, comprising the steps of: 

assuming that the coordinates for the positions of the 
10 left and right cameras and the coordinates of the rotation 

angles of the left and right cameras are linear or nonlinear 
polynomials of a time or an image coordinate, and then 
deriving collinear equations consisting of various 
Expressions; 

15 calculating the coordinate value of a straight line Sq 

for connecting a focal point S of the left image and the one 
point q of the left image; 

substituting the calculated coordinate value of the 
straight line Sq into the collinear equation of the one point 
20 q' of the right image; and 

combining the Expressions of the substituted collinear 
equation, and deriving an equation of the epipolar curve C'q 
of the right image for the one point q of the left image. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 
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The foregoing and other objects, features and advantages 
of the present invention will become more apparent from the 
following detailed description when taken in conjunction with 
the accompanying drawings in which: 

Fig. 1 is a diagrammatic view illustrating an epipolar 
curve of a stereoscopic image photographed by a perspective 
sensor according to the prior art; 

Fig. 2 is a flowchart illustrating the process for 
extracting an epipolar curve of a stereoscopic image 
photographed by a linear pushbroom (LPB) sensor according to a 
preferred embodiment of the present invention; and 

Fig. 3 is a graph illustrating a distribution of an 
epipolar curve of a stereoscopic image photographed by a 
linear pushbroom (LPB) sensor according to a preferred 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

Reference will now be made in detail to the preferred 
embodiments of the present invention. 

Fig. 2 is a flowchart illustrating the process for 
extracting an epipolar curve of a stereoscopic image 
photographed by a linear pushbroom (LPB) sensor according to a 
preferred embodiment of the present invention, and Fig. 3 is a 
graph illustrating a distribution of an epipolar curve of a 



stereoscopic image photographed by a linear pushbroom (LPB) 
sensor according to a preferred embodiment of the present 
invention . 

Referring to Figs. 2 and 3, first, an extraction of the 
epipolar curve of the stereoscopic image photographed by the 
linear pushbroom (LPB) sensor requires a sensor model 
re p reS entating of the relationship between a camera used at 
the time when the camera photographed each image and the earth 
re f erence coordinate system. Such a sensor model can be 
expressed by using the following collinear equation. 

Of course, the collinear equation for the linear 

pushbroom sensor (LPB) may be written a little differently 

from the following Expressions according to circumstances, but 

it should be noted that the present invention is not limited 

to the collinear equation written by a specific Expression. 

[Expression 1] 

r n (X-XJ + r 21 (7-r,) + r 31 (Z-ZJ 



x,=0 = -f 



r^X-XJ + r^Y-YJ + r^Z-ZJ 



[Expression 2] 

= _ r^X-XJ + r^Y-YJ + r^Z-ZJ 
y ' J ^(X-XJ + r^Y-YJ + r^Z-ZJ 

[Expression 3] 

_ , r' n (X -X\) + r\ x (7 -Y\) + r' 3l (Z - Z\ ) 
J r' 13 (X -X\) + r 2i (Y -Y\) + r' 33 (Z - Z\. ) 

[Expression 4] 
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, r\ 2 (X-X\) + r\ 2 (r-rj + r^ (Z-Z' A ) 



Vr f r\ 3 {X - X\ ) 4- r' 23 (7 + r' 33 (Z - Z', ) 

A coordinate (xi,yi) in the above [Expression 1] and 
[Expression 2] denotes a coordinate of one point q of the left 
image, and a coordinate (x r ,y r ) in the [Expression 3] and 
5 [Expression 4] denotes a coordinate of one point q' of the 

right image . 

In the linear pushbroom (LPB) sensor of the present 
invention, a separate focal point exists by each line or part 
within an image of an object and a resultant image coordinate 
10 system is defined accordingly. Hence, the coordinate values of 

X! and x r in the [Expression 1] and [Expression 3] are set to 
0, respectively. 

In the Expressions, (X,Y,Z) denotes a coordinate of the 
ground point Q on a ground reference coordinate system, and 
15 (X s ,Ys,Z s ) and (X' s , Y' s , Z' s ) denote coordinates of focal points 

S and S' of the left image and a focal point S' of the right 
image on the ground reference coordinate system, respectively. 

Also, f denotes a focal length of the linear pushbroom 
(LPB) sensor which has photographed the left image, and f 
20 denotes a focal length of the linear pushbroom (LPB) sensor 

which has photographed the right image. 

r ir r 33 denotes coefficients of a rotational 
transformation matrix for making a coordinate system of the 
left image coincident with the ground reference coordinate 



8 



system, and can be expressed by means of rotating angles 
ki, $1,0)1 at which a camera rotates about X, Y and Z axes as the 
[Expression 5] : 

[Expression 5] 

5 



(r 


r n 


r ^ 

r 13 




( cos$ cos^ -cos$ sin^ 




hi 


r 22 


r 23 




sinq sin$ cosftj +cost} sinftj -sinq sin$ sinftj +cos&} cosfc, 


-sin&j cos$ 


V r 31 


r 32 


r 33^ 




^-cosz} sin$ cos^ +sinq sin^ cos&} sin$ sinSj +cos&j cosfc, 


COSftJCOSj^ ^ 



It can be seen from [Expression 5], that r'ii~r' 3 3 in the 
[Expression 3] and [Expression 4] denotes coefficients of a 
rotational transformation matrix for making a coordinate 

10 system of the right image coincident with the ground reference 

coordinate system, and can be expressed similarly to the 
[Expression 5] through the use of the rotating angles k r ,$ r ,G) r . 

That is, in the linear pushbroom (LPB) sensor unlike a 
conventional perspective sensor, since a separate focal point 

15 exists by each line or part within an image of an object and a 

posture of the camera may be varied by each line or part, 
(Xs,Y s ,Z s ) and (X' s , Y' s , Z' s) in the [Expression 1] through 
[Expression 4] can be expressed in a linear or nonlinear 
polynomial for xi and x r according to the photographing method 

20 or scanning method. 

In addition, the rotating angles ki,<E>i,coi at which a 
camera rotates about X, Y and Z axes to make the coordinate 
system of the left image coincident with the ground reference 
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coordinate system and the rotating angles k r ,O rr co r at which a 
camera rotates about X, Y and Z axes to make the coordinate 
system of the right image coincident with the ground reference 
coordinate system can also be expressed by the linear or 
nonlinear polynomial for xi and x r , respectively. 

The epipolar curve of the stereoscopic image 
photographed by the linear pushbroom (LPB) sensor can be 
extracted by the following Expression on the basis of the 
above-mentioned collinear equation. 

Next, the process for extracting the epipolar curve of 
the stereoscopic image photographed by the linear pushbroom 
(LPB) sensor will be described in detail hereinafter with 
reference to Fig. 2. 

First, at step S100, after assuming that the coordinate 
(X S/ Y s ,Zs) for a position of the left camera, the coordinate 
(X' s , Y' s , Z' s ) for a position of the right camera, the 
coordinate of the rotating angle ki,4>i,coi of the left camera, 
and the coordinate of the rotating angle k r ,O r ,« r of the right 
camera are the linear or nonlinear polynomials for xi and x r , 
respectively, they are substituted into the collinear equation 
written in [Expression 1] through [Expression 4] . 

At subsequent step S110, a straight line Sq for 
connecting a focal point S of the left image and one point q 
of the left image' is calculated by [Expression 6] using a 
parameter k. 
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[Expression 6] 

(X,Y,Z) = (X S , Y S / Z s )+k(x'i,y'i, z' x ) 

Here, (x' i, y' i, z' i) can be expressed by the following 
[Expression 7] . 

[Expression 7] 
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Subsequently, at step S120, the coordinate value of the 
straight line Sq obtained by [Expression 6] is substituted 
into the collinear equation derived from the step S100. At 
step S130, the Expressions of the substituted collinear 
equation are combined, and a resultant epipolar curve C'q of 
the right image for the one point q(xi,y x ) of the left image 
can be expressed by a nonlinear equation of the following 
[Expression 8] . 

[Expression 8] 

= A* i + A 2yi + A s 

Vr ~ (A 4 x l +A 5 y l A 6 )sinQ(x r ) + (A 1 x l + A, yi + A 9 )cosQ(x r ) 

A1-A9 in the [Expression 8] denotes constants determined 
by a given coordinate value (xi,yi) of the one point q of the 
left image, and Q(x r ) denotes a linear or nonlinear equation 
of the coordinate x r for the one point q' of the right image. 

In the case where the epipolar curve according to the 
present invention is drawn actually on the basis of the 
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[Expression 8], the epipolar curve appears in the form of a 
hyperbola as shown in Fig. 3. 

That is, as shown in Fig- 3, the epipolar curve of the 
linear pushbroom (LPB) sensor appears in the form nearly close 
5 to a hyperbola but not a straight line. 

As described above, the typical features of the epipolar 
curve of the linear pushbroom (LPB) sensor according to the 
present invention are as follow: 

1) The epipolar curve of the linear pushbroom (LPB) 
10 sensor appears in the form of a curved line but not a straight 

line . 

2) The epipolar curve of the linear pushbroom (LPB) 
sensor can be assumed to be a straight line in a small region 
within a stereoscopic image photographed by the linear 

15 pushbroom (LPB) sensor. 

3) If it is assumed that an epipolar curve C' q of the 
right image is obtained from one point q of the left image of 
a stereoscopic image photographed by linear pushbroom (LPB) 
sensor and an epipolar curve C q < of the left image is obtained 

20 from one point q' of the right image corresponding to the one 

point q of the left image, in the case of a stereoscopic image 
photographed by the linear pushbroom sensor all the points on 
the epipolar curve C' q are not mapped onto the epipolar curve 
C q r and all the points on the epipolar curve are not mapped 

25 onto the epipolar curve C' q unlike the case of a stereoscopic 
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image photographed by a perspective sensor. 

4) In the case of obtaining C' q and C q r in the feature 
3), it can be assumed that points on the epipolar curve C' q 
are mapped onto the epipolar curve C q > and points on the 
epipolar curve C q ' are mapped onto the epipolar curve C' q only 
for both a small region near the one point q of the left image 
and a small region near the one point q' of the right image. 

As can be seen from the foregoing, a method of 
extracting an epipolar curve of a stereoscopic image 
photographed by a linear pushbroom (LPB) sensor according to 
present invention has the following advantages. 

First, since a method of extracting epipolar curve of a 
stereoscopic image photographed by a conventional perspective 
sensor is different from the method of extracting epipolar 
curve of the stereoscopic image photographed by the linear 
pushbroom (LPB) sensor, it is clear that the conventional 
epipolar curve extracting method for a perspective sensor 
cannot be applied to the linear pushbroom (LPB) sensor of the 
present invention . 

Second, the epipolar curve of the stereoscopic image 
taken from the linear pushbroom (LPB) sensor can be extracted 
by a collinear equation of the epipolar curve proposed in the 
present invention . 

Third, it is clear that all the methods associated with 
extraction of the epipolar curve applicable for processing a 



stereoscopic image photographed by a conventional perspective 
sensor cannot be applied to the stereoscopic image 
photographed by the linear pushbroom (LPB) sensor. 

Fourth, since the epipolar curve of the stereoscopic 
image photographed by the linear pushbroom (LPB) sensor can be 
expressed in a precise Expression, a processing of the 
stereoscopic image of the linear pushbroom (LPB) sensor is 
possible . 

While this invention has been described in connection 
with what is presently considered to be the most practical and 
preferred embodiment, it is to be understood that the 
invention is not limited to the disclosed embodiment, but, on 
the contrary, it is intended to cover various modifications 
within the spirit and scope of the appended claims. 
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